TITLE OF THE INVENTION 


COORDINATE INPUT APPARATUS AND METHOD, AND COMPUTER- 
READABLE MEMORY THEREFOR 

5 

FIELD OF THE INVENTION 

"^p^ This invention relates to a coordinate input 

apparatus and method in which Ixght from a designating 

in 

tfi 10 tool is applied to a prescribed position on a coordinate 
H input screen to produce a beam spot and coordinates 

s corresponding to the beam spot are generated. The 

invention further relates to a computer-readable memory 
Iff storing the program code for this apparatus and method. 

r=V 15 

BACKGROUND OF THE INVENTION 


Known examples of an input apparatus according to 
the prior art include one in which a beam spot on a 

20 screen is sensed using a CCD area sensor or linear 

sensor and image processing using coordinates of the 
center of gravity or pattern matching is executed to 
calculate and output coordinate values, and one in which 
use is made of a position sensing device referred to as 

25 a PSD (an analog device in which an output voltage 

corresponding to the position of the spot is obtained) . 
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By way of example, the specification of Japanese 
Patent Publication (KOKOKU) No. 7-76902 discloses an 
apparatus in which a beam spot produced by a parallel 
beam of visible light is sensed by a video camera to 
5 detect the coordinates of the beam spot and, at the same 
time, a control signal is sent and received in the form 
of infrared diffused light. Further, the specification 
of Japanese Patent Application Laid-Open (KOKAI) No. 
6-274266 discloses an apparatus in which coordinates are 
10 detected using a linear CCD sensor and a special optical 
mask. 

On the other hand, Japanese Patent No. 2503182 
discloses the construction of an apparatus which uses a 
PSD and a method of correcting output coordinates in 

15 this apparatus. 

Improvements in the brightness of large-screen 
displays are continuing and, at the same time, these 
displays are being increased in size and provided with 
higher resolution. 

20 A small, inexpensive apparatus which uses a ring 

CCD and is strongly resistant to the effects of 
extraneous light has been proposed as such a coordinate 
input apparatus. With this coordinate input apparatus, 
the pixels of the CCD are partitioned by computation to 

25 obtain a resolution that is 2"^ times the actual number 
of pixels. For example, in a case where a 64-pixel CCD 
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m 


is used and the screen is divided into 1024 portions to 
accommodate a larger screen, a large- screen coordinate 
input apparatus can be constructed in theory if one 
pixel is divided into 16 portions. However, though 
5 resolution can be raised in this case, a problem which 
arises is that the apparatus is readily susceptible to 
the effects of extraneous light, namely light other than 
input light from a designating tool. 

10 SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is 
to provide a coordinate input apparatus, method and 
related computer-readable memory through which a large 

15 screen and high resolution can be obtained and 

coordinates can be input in highly precise fashion. 

According to the present invention, the foregoing 
object is attained by providing a coordinate input 
apparatus in which light from a designating tool is 

20 applied to a prescribed position on a coordinate input 
screen to produce a beam spot and coordinates 
corresponding to the beam spot are generated, the 
apparatus comprising: a plurality of sensing means 
provided in the vicinity of at least one coordinate axis 

25 for sensing the beam spot; correction means for 

correcting results of sensing from each of the plurality 
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of sensing means; concatenation means for concatenating 
data that has been corrected by the correction means; 
and output means for outputting coordinate values 
corresponding to the beam spot based upon the data 
5 concatenated by the concatenation means; wherein light- 
receptive areas of the plurality of sensing means have 
overlapping portions. 

The correction means preferably corrects the 
results of sensing from each of the plurality of sensing 

10 means based upon reference coordinate values that have 
been stored in advance. 

Each of the plurality of sensing means preferably 
is a linear sensor comprising a plurality of 
optoelectronic transducers arrayed on a straight line. 

15 The correction means preferably corrects the 

results of sensing from each of the plurality of sensing 
means based upon inclination of second sensing means 
relative to first sensing means among the plurality of 
sensing means. 

20 The correction means preferably corrects the 

results of sensing from each of the plurality of sensing 
means based upon a magnification, which is for 
calculating coordinates, set for each of the plurality 
of sensing means. 

25 According to the present invention, the foregoing 

object is attained by providing a coordinate input 
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method in which light from a designating tool is applied 
to a prescribed position on a coordinate input screen to 
produce a beam spot and coordinates corresponding to the 
beam spot are generated, the apparatus comprising: a 
5 correction step of correcting results of sensing from 
each of a plurality of sensing units provided in the 
vicinity of at least one coordinate axis for sensing the 
beam spot; a concatenation step of concatenating data 
that has been corrected at the correction step; and an 

10 output step of outputting coordinate values 

corresponding to the beam spot based upon the data 
concatenated at the concatenation step; wherein light- 
receptive areas of the plurality of sensing units have 
overlapping portions. 

15 According to the present invention, the foregoing 

object is attained by providing a computer-readable 
memory storing coordinate- input program code, in which 
light from a designating tool is applied to a prescribed 
position on a coordinate input screen to produce a beam 

20 spot and coordinates corresponding to the beam spot are 
generated, said program code comprising: program code 
of a correction step of correcting results of sensing 
from each of a plurality of sensing units provided in 
the vicinity of at least one coordinate axis for sensing 

25 the beam spot; program code of a concatenation step of 
concatenating data that has been corrected at the 


correction step; and program code of an output step of 
outputting coordinate values corresponding to the beam 
spot based upon the data concatenated at the 
concatenation step; wherein light-receptive areas of the 
plurality of sensing units have overlapping portions. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram schematically illustrating the 
construction of a coordinate input apparatus according 
to an embodiment of the present invention; 

Fig. 2 is a diagram illustrating the detailed 
construction of a designating tool according to the 
embodiment ; 

Fig. 3 is a diagram illustrating the operating mode 
of the designating tool according to the first 
embodiment ; 

Fig. 4 is a diagram illustrating the detailed 
construction of a coordinate detector according to the 
embodiment ; 


Fig. 5 is a timing chart illustrating restoration 
of a control signal according to the embodiment; 

Fig. 6 is a timing chart illustrating signals 
handled according to the embodiment; 

Fig. 7 is a diagram showing the positional 
relationship of linear sensors 20Xa, 20Xb, 20Ya, 20Yb 
according to the embodiment; 

Fig. 8 is a diagram illustrating the detailed 
construction of a linear sensor according to the 
embodiment ; 

Fig. 9 is a diagram illustrating an example of 
output waveforms of the linear sensors according to the 
embodiment ; 

Fig. 10 is a diagram illustrating an example of an 
output waveform for describing a skimming operation of 
the linear sensor according to the embodiment; 

Fig. 11 is a flowchart illustrating control of 
operation of the linear sensors according to the 
embodiment ; 

Fig. 12 is a diagram illustrating the construction 
of the linear sensor according to the embodiment; 

Fig. 13 is a flowchart illustrating the flow of 
coordinate calculation processing according to the 
embodiment ; 

Fig. 14 is a diagram useful in describing the 
definition of reference coordinates according to the 


embodiment ; 

Fig. 15 is a flowchart illustrating the flow of 
processing for calculating a concatenated coordinate 
CCDX according to the embodiment; 

Fig. 16 is a diagram useful in describing 
inclination of a linear sensor; and 

Fig. 17 is a diagram useful in describing a 
coordinate changeover point in a case where a linear 
sensor is inclined. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

A preferred embodiment of the present invention 
will now be described in detail with reference to the 
drawings . 

The general construction of an optical coordinate 
input apparatus according to the present invention will 
be described with reference to Fig. 1- 

Fig. 1 is a diagram schematically illustrating the 
construction of a coordinate input apparatus according 
to an embodiment of the present invention. 

Broadly speaking, the coordinate input apparatus 
comprises a designating tool 4 for forming a beam spot 5 
on a screen 10 serving as a coordinate input surface, 
and a coordinate detector 1 for detecting the 
coordinates of the position of a beam spot 5 on the 


screen 10. Fig. 1 illustrates a projection- type display- 
unit 8 which, in combination with these components, 
serves as an output device for displaying an image or 
positional coordinates on the screen 10. 
5 The coordinate detector 1 includes a coordinate 

sensing unit 2, a controller 3 for controlling the 
coordinate sensing unit 2 and calculating coordinates, a 
photoreceptor 6 and a signal processor 7 . The 

f J 

^rj coordinate detector 1 is adapted to detect the 

cn 

in 10 coordinates of the beam spot 5 on the screen 10 and 

\ si 

control signals corresponding to various states 

•% 

m (described later) of the designating tool 4, and to 

n transmit this information to an externally connected 

J? unit (not shown) by the controller 3. 

JL{ 15 The project ion- type display unit 8 comprises an 

image signal processor 81 to which is input an image 
signal from a display signal source constituted by an 
externally connected device such as a host computer {not 
shown) , a liquid crystal display panel 82 controlled by 
20 the processor 81, an illuminating optical system 

comprising a lamp 83, a mirror 84 and a condenser 85, 
and a projecting lens 86 for projecting the image of the 
liquid crystal panel 82 onto the screen 10, whereby 
desired information can be displayed on the screen 10. 
25 The latter has a suitable light diffusing property in 
order to broaden the range over which the projected 
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image can be observed. As a result, the light beam 
emitted from the designating tool 4 also is diffused at 
the position of the beam spot 5 so that some of the 
light diffused at the position of the beam spot 5 will 
impinge upon the coordinate detector 1 regardless of the 
position on the screen and the direction of the light 
beam. 

By virtue of this arrangement, character 
information or line-drawing information is input on the 
screen 10 by the designating tool 4 and this information 
is displayed by the project ion- type display unit 8, 
whereby it is possible to input or output information 
just as if a pencil and paper were being used. In 
addition, a button operation or an input operation such 
as selection of an icon can be performed freely. 
<Detailed description of designating tool 4> 
Fig. 2 is a diagram illustrating the details of the 
designating tool 4 according to this embodiment. 

As shown in Fig. 2, the designating tool 4 is 
internally provided with a light-emitting element 41 
such as a semiconductor laser for emitting a light beam 
or an LED for emitting infrared light, a light-emission 
controller 42 for driving and controlling the light 
emission, a power supply unit 44 such as a battery, 
operating switches 43A to 43D, and a removable cap 46 
consisting of a transparent member for covering the 
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light -emit ting element 41, The light-emission 
controller 42 perfoirms light-emission control, in which 
control signals are superimposed, by turning the light 
emission on and off depending upon the states of the 
operating switches 43A to 43D and a modulating method 
described later. 

Fig. 3 illustrates the operating modes of the 
designating tool 4 according to this embodiment. 

Switches A to D correspond to the switches 43A to 
43D, respectively, of Fig. 2. In Fig. 3, "light 
emission" corresponds to a light-emission signal 
(coordinate signal) , and "pen down" and "pen button" 
correspond to control signals. 

The operator grasps the designating tool 4 and 
points its tip toward the screen 10. The switch 43A is 
placed at a position where it will be contacted 
naturally by the operator's thumb. Pressing the switch 
43A causes the emission of a light beam 45. As a 
result, the beam spot 5 is produced on the screen 10 and 
a coordinate signal starts being output by predetermined 
processing. In this state, however, the pen-down and 
pen-button control signals are OFF. As a consequence, 
only an indication of a designated position is presented 
to the operator as by motion of a cursor or a changeover 
in the highlighting of a button, etc. 
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By pressing the switches 43C and 43D, which are 
placed at positions contacted naturally by the 
operator's index and middle fingers, the pen-down and 
pen-button control signals become signals superimposed 
5 upon the light-emission signal, as indicated in Fig. 3. 
In other words, pressing the switch 43C establishes the 
pen-down state, thereby making it possible to execute 
screen control such as the start of a character or line- 
drawing input or the selection of a button. Pressing 

10 the switch 43D establishes the pen-button state, in 

which it is possible to accommodate other functions such 
as the calling of a menu. As a result, by using only 
one hand, the operator can immediately write a character 
or figure correctly at any position on the screen 10 or 

15 can select a button or menu. Thus, the designating tool 
4 can be operated nimbly. 

The ti; > of the designating tool 4 is provided with 
the switch f3B. This switch is operated by pressing the 
tip of the designating tool 4 against the screen 10. 

20 The operatoi grasps the designating tool 4 and presses 
its tip agafl,nst the screen, thereby establishing the 
pen-down snate. Thus, a natural pen input operation can 
be performed without needless operation of buttons. 
The switch 43A has a pen-button function. Of 

25 course, if the switch 43A is pressed without pressing 
the designating tool 4 against the screen, it is 
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possible to move only the cursor. In actuality, rather 
than performing input of a character or figure at a 
distance from the screen, somewhat better operability 
and accuracy are obtained by pressing the designating 
5 tool 4 directly against the screen. In this embodiment, 
a natural, nimble operation thus is possible at a 
distance from the screen or immediately in front of the 

'% screen using the four switches, and the designating tool 

4 can be used properly in accordance with the particular 
10 case. Furthermore, in case of direct input only 
(wherein the designating tool 4 is not used as a 

s pointer) , a diffuse light source will be satisfactory 

and a light beam will not be required. In such case it 

IM is possible to use an LED, which is less expensive than 

□ 15 a semiconductor laser and longer in life. 

Further, the light-emission controller 42 set so as 
to transmit a unique ID number together with a control 
signal in order to deal with a case where two types of 
designating tools 4, one for up-close work and one for 
20 remote work, are used or are operated by two or more 

people simultaneously, or in a case where use is made of 
a plurality of designating tools 4 having different 
attributes such as color and thickness of a drawn line. 
The attributes such as the color and thickness of a 
25 drawn line are decided by software on the side of the 
externally connected device in association with the 
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transmitted ID number, and a button or menu on the 
screen 10 can be set and changed. This operation may be 
performed by providing the designating tool 4 with a 
separate operating button and transmitting a command 
5 signal to effect the change. With regard to these 
settings, the particular state can be retained within 
the designating tool 4 or within the coordinate detector 
1 and the attribute information can be transmitted to 
the externally connected device without use of an ID 
10 number. 

Such an additional operating button makes possible 
the setting of other functions. For example, it is 
possible to turn the display unit on and off, to 
changeover the signal source or to operate a recording 

15 device or the like. Furthermore, it is possible to 

transmit a variety of useful signals. For example, by 
providing one or both of the switches 43A, 43B with 
pressure detecting means, writing pressure can be 
detected and the writing-pressure data can be 

20 transmitted together with a control signal. 

If the switch 43A or 43B of the designating tool 4 
is turned on, emission of light starts and the light- 
emission signal is output. Output first is a header 
comprising a leader, which consists of a comparatively 

25 long sequence of successive pulses, and a code (maker 

ID, etc.) that follows the leader. Next, a transmission 
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data sequence, which comprises the pen ID and control 
signals, etc, is output successively in accordance with 
a sequence and format defined in advance (see signal LSG 
in Fig. 5) . 

5 In this embodiment, the modulation format is such 

that the "1" bits of the data bits have twice the 
intervals of the "0" bits, though various data encoding 
schemes can be used. However, that the average amount 
of light be fixed is desirable in order to detect 

10 coordinates, as will be described later, and that the 
clock component be sufficiently large is desirable in 
order to tune a PLL. In addition, in view of the amount 
of data to be transmitted, there is no harm in providing 
a comparatively high degree of redundancy. Taking these 

15 facts into consideration, this embodiment performs 

encoding through a method wherein 6-bit (64 items of) 
data is assigned to 108 codes in which the numbers of 
"l"s and "0"s are the same and the number of consecutive 
bits which are "l"s or "0"s is three or less in a code 

20 having a length of ten bits. By adopting such an 

encoding scheme, average power is rendered constant and 
a satisfactory clock component is included. This makes 
it possible to readily generate a stable synchronizing 
signal at the time of demodulation. 

25 As mentioned above, the pen-down and pen-button 

control signals are two-bit signals. However, other 
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items of long data such as an ID must also be 
transmitted. Accordingly, in this embodiment, 24 bits 
are adopted as one block, in which the two leading bits 
are for the control signal, the next two bits are for an 
5 internal identification code (e.g., "00" represents the 
writing pressure signal and "11" the ID), the next two 
bits are for the related parity check, the next 16 bits 
represent data and the final two bits are for the 
related parity check. If this data is encoded by the 

10 scheme described above, a signal having a length of 40 
bits will be obtained. A 10-bit sync code is added onto 
the beginning of this signal. The sync code uses a 
special code, namely a code composed of five successive 
"0"s and five successive "l"s or a pattern that is the 

15 inverse thereof (the changeover being made depending 

upon whether the end of the immediately preceding block 
is "1" or "0"). This makes it possible to readily 
distinguish between this code and a data word. In 
addition, a position even along a data string can be 

20 identified with certainty so that the data can be 

reconstructed. In one block, therefore, a transmission 
signal having a length of 50 bits is obtained, and a 
control signal and 16-bit data such as an ID or writing 
pressure are transmitted. 

25 In this embodiment, 7.5 kHz, which is 1/8 of a 

first frequency of 60 kHz, is adopted as a second 
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frequency. However, since the above-mentioned encoding 
scheme is adopted, the average transmission bit rate is 
2/3 of the first frequency, or 5 kHz. Since one block 
is 50 bits, 24-bit data of one block is transmitted at a 
5 frequency of 100 Hz. Accordingly, the effective bit 
rate exclusive of parity is 2000 BPS. Thus, though 
redundancy is high, erroneous detection is prevented and 

P synchronization is achieved with ease. This can be 

realized through a very simple arrangement. Further, by 

^ 10 making joint use of a phase synchronizing signal for 

sensor control, described later, and a check of the 
repetitive period of the sync code, follow-up can be 

s 

D performed even in a case where a signal develops short 

D drop-out. Conversely, a case in which a quick operation 

□ 15 such as pen-up or double- tap has been performed can be 

identified reliably depending upon whether or not there 
is a header signal. 

<Detailed description of coordinate detector 1> 
Fig. 4 is a diagram the details of the coordinate 
20 detector 1 according to this embodiment. 

The coordinate detector 1 is provided with the 
photoreceptor 6 for high- sensitivity detection of amount 
of light by a condensing optical system, and with four 
linear sensors 20Xa, 20Xb, 20Ya, 20Yb for detecting 
25 direction of arriving light by an image-forming optical 
system. Each of these receives diffused light from the 
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beam spot 5 produced on the screen 10 by the light beam 
from the light-emitting element 41 built in the 
designating tool 4. 

<Description of operation of condensing optical 
5 system> 

A condensing lens 6a seirving as a condensing 
optical system is mounted on the photoreceptor 6 for 
□ sensing, with a high sensitivity, the amount of light of 

m a certain wavelength from the entire area of the screen 

if! 

m 10 10. The output of the condensing lens 6a is detected by 

^1 a frequency detector 71, after which the detected signal 

is demodulated by a control signal detector 72 to a 
"J digital signal which includes the data of a control 

:t signal (a signal superimposed by the light-emission 

G 15 controller 42 of the designating tool 4), etc. 

A timing chart of the operation for restoring the 
control signal will now be described. 

Fig. 5 is a timing chart illustrating restoration 
of a control signal according to this embodiment. 
20 The data signal comprising the bit sequence 

described above is sensed as an optical output signal 
LSG by the photoreceptor 6 and this signal is detected 
by the frequency detector 71. The latter is adapted so 
as to be tuned to the pulse cycle of the first 
25 frequency, which is the highest in the optical output 

signal LSG. By making joint use of an optical filter, a 
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modulated signal CMD is demodulated without being 
affected by extraneous light. The detection method is 
similar to that of an infrared remote controller that is 
in wide use and is a highly reliable wireless 
5 communication method. 

In this embodiment; a frequency of 60 kHz, which is 
higher than that of the generally employed infrared 
remote controller, is used as the first frequency, so 
that erroneous operation will not occur even if the 

10 apparatus is used at the same time. However, it is 

possible to place the first frequency in a band the same 
as that of the generally employed infrared remote 
controller, in which case erroneous operation would be 
prevented by identification based upon an ID or the 

15 like. 

The modulated signal CMD detected by the frequency 
detector 71 is interpreted as digital data by the 
control signal detector 72, and a control signal such as 
pen-down or pen button is restored. The restored 

20 control signal is sent to a communication controller 33. 
The period of code modulation of the second frequency 
included in the modulated signal CMD is detected by the 
a sensor controller 31, and the linear sensors 2 OX, 20y 
are controlled by this signal. That is, the sensor 

25 controller 31 is reset at the timing of the header shown 
in Fig. 5, after which a signal LCK phase-synchronized 
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to the falling edge of the modulated signal CMD is 
generated. 

Accordingly, the generated signal LCK is a signal 
of a fixed frequency synchronized to the absence or 
5 presence of a light emission from the designating tool 
4. Further, a signal LON indicating whether or not 
there is a light input and a sensor-reset signal RCL 
activated by the signal LON are generated from the 
modulated signal CMD. The two linear sensors 2 OX, 20Y 

10 are reset while the sensor reset signal RCL is at the 
high level, and a synchronous integration operation, 
described later, starts at the timing of the falling 
edge of the sensor reset signal RCL, which is 
synchronized to the rising edge of the signal LCK. 

15 If the control signal detector 72 detects the 

header and confirms that input from the designating tool 
4 has started and that this is not noise or an input 
from another device, a signal indicative of this 
confirmation is sent from the communication controller 

20 33 to the sensor controller 31, a signal CON indicating 
that operation of the linear sensors 20Xa, 20Xb, 20Ya, 
20Yb is valid is set to the high level and operation of 
a coordinate calculation unit 32 begins. 

Fig. 6 is a timing chart for when the optical 

25 output signal LSG vanishes and a series of operations 
ends. If the modulated signal CMD detected from the 
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optical output signal LSG continues at the low level for 
a fixed period of time or greater, the signal LON 
indicating whether an optical input is present or not 
falls to the low level and so does the signal CON 
5 indicating that sensor operation is valid. As a result, 
the coordinate output operation by the linear sensors 
20Xa, 20Xb, 20Ya, 20Yb is terminated. 

<Description of operation of image-forming optical 

system> 

10 Fig. 7 is a diagram showing the positional 

relationship of the linear sensors 20Xa, 20Xb, 20Ya, 
20Yb. 

The image of the beam spot 5 is formed in the shape 
of a line on each of photosensitive portions 21Xa, 21Xb, 

15 2iya, 21Yb of respective ones of the linear sensors 

20Xa, 20Xb, 20Ya. 20Yb by cylindrical lenses 90Xa, 90Xb, 
90Ya, 90Yb, respectively, serving as the image- foarming 
optical system. By disposing the linear sensors 20Xa, 
20Xb exactly at right angles with respect to the linear 

20 sensors 20Ya, 20Yb, the sensors produce outputs having 
peaks at the pixels which reflect the X and Y 
coordinates, respectively, of the beam spot. 

The linear sensors 20Xa, 20Xb, 20Ya, 20Yb are 
controlled by the sensor controller 31 and the output 

25 signals of the sensors are sent to the coordinate 
calculation unit 32 as digital signals by an A/D 
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converter 31A. The coordinate calculation unit 32 
calculates the output coordinates from the input digital 
signals and sends the result of calculation to an 
external control unit (not shown) by a predetermined 
communication method via the communication controller 33 
together with data such as the control signal from the 
control signal detector 72 . In a case where an 
operation (e.g., setting of a calibration value by a 
user) different from that of the usual operation is 
performed, as when an adjustment is carried out, the 
communication controller 33 sends a mode changeover 
signal to the sensor controller 31 and coordinate 
calculation unit 32. 

According to the present invention, blurring is 
produced intentionally using focusing or a light 
diffusing film in such a manner that the image of the 
beam spot 5 will take on an image width that is several 
times the pixels of the linear sensors 20X, 20Y. Thus, 
the light diffusing plate produces blurring 
intentionally. In accordance with an experiment in 
which use was made of plastic cylindrical lenses having 
a diameter of 1.5 mm, an effective 64-pixel linear CCD 
having a pixel pitch of about 15 ]m and an infrared LED, 
it was found that if the image is formed to maximum 
shaipness, an image width of less than 15 ^m is obtained 
over the entirety of a field angle of about 40*. It was 
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found that trace drawn by the result of pixel-to-pixel 
partitioning calculation was distorted in stepwise 
fashion under these conditions. Accordingly, very 
smooth coordinate data was obtained when the position of 
5 the lens was adjusted so as to provide an image width of 
30 to 60 \m. Of course, if blurring is made excessive, 
the peak level will decline. An image width on the 

order of several pixels, therefore, is best. One 

^5 ... 

characterizing feature of the present invention is to 

^ 10 use a CCD having a small number of pixels and an optical 

system which furnishes a suitable amount of blurring. 

By using such a combination, it is possible to realize 

an inexpensive coordinate input apparatus in which the 

^ amount of calculation data is small and with which a 

irl 15 very high resolution, high precision and high speed can 

p be obtained using a small sensor and optical system. 

The linear sensors 20Xa, 20Xb for sensing X 

coordinates and the linear sensors 20Ya, 20Yb for 

sensing Y coordinates, which are disposed in the form of 

20 an array, are identical in construction. The details of 

this construction will be described with reference to 

Fig. 8. 

Fig. 8 is a diagram illustrating the detailed 
construction of a linear sensor according to this 
25 embodiment. 
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A sensor array 21 which is the photoreceptor unit 
comprises N-number of pixels (64 in this embodiment) . 
Electric charge conforming to the amount of received 
light is stored in an integrator 22. The integrator 22, 
5 which comprises 64 integrators, can be reset by applying 
a voltage to a gate ICG, This makes possible an 
electronic shutter operation. The electric charge that 
acciomulated in the integrator 22 is transferred to a 
storage unit 23 by applying a pulsed voltage to an 

10 electrode ST. The storage unit 23 comprises two storage 
units which separately and respectively store electric 
charge in conformity with H and L levels of an IRCLK 
signal synchronized to the light-emission timing of the 
designating tool 4. Thereafter, in sync with the 

15 turning on and off of the light, the electric charge 
that has been separately stored is transferred to a 
linear CCD unit 25, which comprises two CCDs, via a 
shift unit 24, which comprises two shifters, provided in 
order to simplify the transfer clock. 

20 As a result, electric charge corresponding to the 

turning on and off of the light output from the sensor 
of N-number of pixels is stored as a row of contiguous 
charge. The electric charge arrayed in the CCD unit 25 
is transferred successively to a ring CCD 26 comprising 

25 two CCDs. After the ring CCD 26 is emptied by a CLR 
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unit 27 in response to a CLR signal, electric charge 
from the linear CCD unit 25 is stored successively* 

The electric charge thus stored is read out by an 
amplifier 29. The latter outputs non-destructively a 
5 voltage proportional to the amount of stored charge. In 
actuality, the difference between mutually adjacent 
amounts of charge, namely a value obtained by 
subtracting amount of charge in the absence of a light 
'"'i emission from amount of charge at emission of light from 

^1 10 the light -emit ting element 41, is amplified and output. 

W. An example of the output waveforms obtained from 

H the linear sensors 20Xa, 20Xb, 20Ya, 20Yb at this time 

2 will be described with reference to Fig. 9. 

•*y Fig. 9 is a diagram illustrating an example of 

in 15 output waveforms of the linear sensor according to this 

Q embodiment . 

Waveform B in Fig. 9 is obtained when only a signal 
prevailing at the time of light emission from the light- 
emitting element 41 is read out, and waveform A is that 
20 in the absence of a light emission, i.e., a waveform 
which represents only extraneous light. (As shown in 
Fig. 8, the electric charge of pixels corresponding to 
the waveforms A and B is arrayed in contiguous fashion 
in the ring CCD 26.) The amplifier 29 non-destructively 
25 amplifies and outputs the difference (waveform B - 

waveform A) between the neighboring amounts of charge. 
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As a result, a signal representing an image which is 
solely light from the designating tool 4 can be obtained 
and a stable coordinate input is possible without the 
effects of extraneous light (noise) . 

Let the maximum value of the difference B-A between 
the waveforms shown in Fig. 9 be defined as the peak 
value. If the storage time during which each of the 
linear sensors of linear sensors 20Xa, 20Xb, 20Ya, 20Yb 
functions with respect to the light is lengthened, the 
peak value increases in conformity with this time. In 
other words, if the time of one period of the IRCLK 
signal is adopted as unit charging time and number n of 
times storage is performed is defined using this time as 
the unit, the peak value will be enlarged by increasing 
the number n of times storage is performed. By 
detecting that the peak value has attained a 
predetermined threshold value THl, it is possible to 
obtain an output waveform having a constant quality at 
all times. 

In a case where the extraneous light is very 
intense, there is the danger that the transfer charge of 
the ring CCD 26 will saturate before the peak of the 
difference B-A between the waveforms will become 
sufficiently large. In consideration of such a case, 
each of the linear sensors of linear sensors 20Xa, 20Xb, 
20Ya, 20Yb is provided with a SKIM unit 28 having a skim 


function. The SKIM unit 28 monitors the level of the 
signal which prevails in the absence of a light 
emission. When the signal level of a waveform indicated 
An exceeds a predetermined value (see the one-dot chain 
5 line in Fig. 10) at an nth charge in Fig. 10, a fixed 
amount of charge is extracted from each pixel of A and 
B. As a result, a waveform indicated at An+1 is 
obtained at the next (n+l)th charge. By repeating this 
operation, saturation will not occur and storage of 

10 signal change can continue even if extraneous light is 
very intense. 

Accordingly, even if the amount of light from the 
designating tool 4 when the light from latter is turned 
on and off is very small, a sufficiently large signal 

15 waveform can be obtained by continuing the integrating 
operation a number of times. In particular, since the 
signal of a displayed image is superimposed in a case 
where a light-emitting source of the visible light 
region is used for the designating tool 4, a sharp 

20 waveform containing very little noise can be obtained by 
using the above-described skim function and differential 
output . 

Control of the operation of linear sensors 20Xa, 
20Xb, 20Ya, 20Yb will now be described with reference to 
25 Fig. 11. 
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Fig. 11 is a flowchart illustrating control of 
operation of the linear sensors according to this 
embodiment . 

When the sensor controller 31 starts sensor 
5 control, the controller monitors the signal CON at step 
S102. If the signal CON is at the high level ("YES" at 
step S102), control proceeds to step S103 and the number 
n of integrating operations is reset to zero. Next, at 
step S104, the controller determines whether the peak 

10 value (peak level) of the sensor output is greater than 
the predetermined threshold value THl. 

If the peak value is equal to or less than the 
predetermined threshold value THl ("NO" at step S104), 
the controller 31 determines whether the number n of 

15 integrating operations is greater than a first 

predetermined number nO. If the number n of integrating 
operations is equal to or less than the first 
predetermined number nO ("NO" at step S105) , control 
proceeds to step S106. Here the number n of integrating 

20 operations is incremented and control returns to step 
S104. On the other hand, if the peak value is greater 
than the predetermined threshold value THl ("YES" at 
step S104), or if the number n of integrating operations 
is greater than the first predetermined number nO {"YES" 

25 at step S105) , control returns to step S107. Here an 
integration-stop signal RON attains the high level and 
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the integration operation is halted. Further, 
coordinate-value calculation by the coordinate 
calculation unit 32 starts. 

This is followed by step S108, at which the sensor 
controller 31 detemines whether the number n of 
integrating operations is greater than a second 
predetermined number nl. If the number n of integrating 
operations is equal to or less than the second 
predetermined nxomber nl ("NO" at step S108) , control 
proceeds to step S109, at which the number n of 
integrating operations is incremented and control 
returns to step S108. On the other hand, if the number 
n of integrating operations is greater than second 
predetermined number nl ("YES" at step S105) , control 
proceeds to step SllO, the integration-stop signal RON 
falls to the low level and, at the same time, the sensor 
reset signal RCL attains the high level for a length of 
time that is several times the cycle of the signal LCK 
(twice the cycle of the signal LCK in the example of 
Fig, 10) . Next, at step S112, the sensor controller 31 
monitors the signal CON. If the signal CON is at the 
high level ("YES" at step S112), control proceeds to 
step S103 . On the other hand, if the signal CON is at 
the low level ("NO" at step S112), control returns to 
step Sill and the system waits for one cycle time. 
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In other words, this operation is repeated during 
the time that the signal CON is at the high level, and 
the calculation of coordinates is carried out every 
cycle decided by second predetermined niimber nl. The 
5 step Sill is provided so as to hold the prevailing state 
only one time even if the signal CON drops owing to the 
effects of dust or the like. If the signal CON is at 
the low level for two consecutive cycles ("NO" at step 
S102), control returns to step S113, a flag PON is reset 

10 to 0, a sync-signal standby state is attained and 
control returns to the initial state. 

The drop-out countermeasure can be lengthened 
beyond one cycle. It goes without saying that if 
external disturbance is small, then, conversely, the 

15 drop-out countermeasure can be shortened. It should be 
noted that a similar operation can be performed by 
adopting one cycle as a natural -number multiple of the 
period of the data clock, making this coincide with the 
timing of the sync clock and using a sync-code detection 

20 signal instead of the signal CON. 

Light from the designating tool 4 that reaches the 
coordinate detector fluctuates owing to consumption of 
the power supply (battery) 44 accommodated within the 
designating tool 4 and is also caused to fluctuate by 

25 the attitude of the designating tool 4. In particular, 
in a case where the screen 10 diffuses little light, the 
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frontal brightness of the displayed image rises but the 
attitude of the designating tool 4 causes a greater 
fluctuation in the amount of light input to the sensor. 
According to the present invention, however, even in 
this case the number of times integration is performed 
follows up automatically and a stable output signal can 
be obtained at all times. This provides excellent 
effects in which it is possible to detect coordinates in 
a stable manner. In a case where light impinges upon 
the sensor without being scattered much when the 
designating tool 4 is used as a pointer, light of 
considerable intensity enters the sensor. However, 
coordinates can be detected in stable fashion even in 
this case. 

Further, in a case where joint use is made of a pen 
and pointer employing an LED used upon being brought 
into direct contact with the screen, it is possible to 
use an LED that produces a greater quantity of light. 
Accordingly, the first predetermined number of times nO 
and second predetermined number of times nl, which are 
the number of integrating operations shown in Fig. 11, 
can be switched between upon differentiating between the 
pen and pointer based upon the ID signal. The sampling 
rate is raised in the case of the pen and is lowered in 
the case of the pointer. In actuality, a fine writing 
operation such as a character input is impossible with a 


in 


pointer. Better operability is obtained writing a 
smooth line by a low sampling rate. Providing the 
changeover is advantageous for this purpose. 

As described above, control of the timing of the 
5 integrating operation is carried out by a demodulated 
signal of a prescribed period obtained by applying a 
high-frequency carrier to light that is turned on and 
off and detecting the frequency of this carrier. As a 
result, the designating tool and the image sensing unit 

10 can be synchronized cordlessly, thus making it possible 
to realize a coordinate input apparatus that is very 
easy to use. A further advantage is that the apparatus 
can be operated easily at a position remote from the 
screen by using a laser beam. Further, since 

15 integration control means is provided in which 

integration is halted in response to detection of the 
fact that a peak level in a difference signal from an 
integrating unit has exceeded a predetermined level, a 
signal representing a beam-spot image of a substantially 

20 constant level can be produced even if the amount of 

light varies. This makes it possible to obtain results 
of coordinate calculation that are stable and high in 
resolution at all times. 

<Calculation of coordinate values> 

25 Coordinate calculation processing by the coordinate 

calculation unit 32 will now be described. 
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The output signals from the four linear sensors 
20Xa, 20Xb, 20Ya, 20Yb (the difference signal from the 
amplifier 29) obtained as described above are converted 
to a digital signal by the A/D converter 31A provided in 
5 the sensor controller 31, and the digital signal is 
transmitted to the coordinate calculation unit 32, 
whereby coordinates are calculated. In the calculation 
of coordinates, first coordinates are obtained with 
^2 respect to the outputs in each of the X and Y 

Rj 10 directions. This calculation processing is the same for 

In both X and Y and therefore will be described solely with 

regard to the X direction, 

iri 

£ As shown in Fig. 12, each of the linear sensors 

S 20Xa, 20Xb is constructed as a detection area having 

15 half the longitudinal length of the screen 10. The 
detection areas overlap each other in the vicinity of 
the center of the screen. 

The linear sensor 20Xa senses light in a case where 
the beam spot resides in an area SXa of the screen 10, 
20 and the linear sensor 20Xb senses light in a case where 
the beam spot resides in an area SXb of the screen 10. 
Both sensors sense the beam spot in the area of overlap. 

According to the present invention, coordinate 
values are discriminated based upon the peak values of 
25 the outputs obtained from the linear sensors 20Xa, 20Xb, 
20Ya, 20Yb. 
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Reference will be had to Fig. 13 to describe the 
flow of processing for calculating coordinates according 
to this embodiment. 

Fig. 13 is a flowchart illustrating the flow of 
coordinate calculation processing according to this 
embodiment , 

Let DXa, DXb represent the outputs of the ring CCDs 
26 of linear sensors 20Xa, 20Xb, respectively. As 
explained earlier, these values are values obtained by 
an analog-to-digital conversion and therefore are 
voltage values that conform to the amount of sensed 
light for each pixel of the ring CCD 26. The peak level 
can be decided using the maximum value of each item of 
data . 

Let CCDXa, CCDXb represent the coordinates sensed 
by the linear sensors 20Xa, 20Xb, respectively. 

First, at step S201, difference data DXa(n) (number 
n of pixels in this embodiment is equal to 64) which is 
a difference signal regarding each pixel at an arbitrary 
coordinate input point is read in and stored in a buffer 
memory (not shown). Next, at step S202, the difference 
value is compared with a preset threshold value V and a 
data value Exa(n) greater than the threshold value is 
calculated. The coordinate CCDXa on the linear sensor 
20Xa is calculated at step S203 using the data value 
Exa(n) . In this embodiment, the center of gravity of 
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the output data is calculated by the center-of-gravity 
method. However, it goes without saying that the 
present invention is not limited to this calculation 
method, for there is a method of finding the peak value 
5 of the data value Exa(n) by, e.g., differentiation. 

The coordinate CCDXb on the linear sensor 20Xb also 
is calculated in a similar manner. 

These calculated coordinates are coordinates which 
correspond to pixels on the linear CCDs 26 of the linear 
10 sensors 20Xa, 20Xb, respectively. By connecting these 
coordinates, therefore, they may be handled as 
coordinates on the linear sensors 20Xa, 20Xb. 

Accordingly, we define reference coordinates for 
connecting coordinates corresponding to pixels on the 
15 linear CCDs 26 of the linear sensors 20Xa, 20Xb. 

This definition of reference coordinates will be 
described using Fig. 14. 

Fig. 14 is a diagram useful in describing the 
definition of reference coordinates according to the 
20 embodiment 

Fig. 14 illustrates an arrangement in which the 
coordinates of the linear CCDs 26 of the respective 
linear ^sensors 20Xa, 20Xb are disposed conceptually. 


Sinc^^e^ detection areas of the linear sensors 20Xa, 
25 20Xb have the overlapping portions, as described 
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^^^^-^£^1 -^^ results when these coordinate positions 

are ^^lapped. 


The linear CCDs 26 of the respective linear sensors 
20Xa, 20Xb are both measurable areas and define a 
5 reference point in advance. More specifically, an input 
is applied to the overlapping portions on the screen 10 
and is read in as coordinates CCDXa, CCDXb {CCDXa__org, 
CCDXb_org) . These values are stored in a non-volatile 
memory (not shown) such as an EEPROM as reference-point 
10 data (reference coordinates) , At the time of ordinary 
use, they are read out and coordinate values are 
calculated. 

Reference will now be had to Fig. 15 to describe 
processing for calculating the concatenated coordinate 
15 CCDX obtained by concatenating the coordinate values 

corresponding to the pixels on the linear CCDs 26 of the 
respective linear sensors 20Xa, 20Xb using the 
reference-point data. 

Fig. 15 is a flowchart illustrating the flow of 
20 processing for calculating a concatenated coordinate 
CCDX according to this embodiment. 

First, at step S207, the reference-point data 
(CCDXa^org, CCDXb_org) of the linear CCDs 26 of the 
respective linear sensors 20Xa, 20Xb are read in from 
25 the memory. Next, at step S208, the differences between 
the values of CCDXa, CCDXb, which are calculated when an 


input arrives from the designating tool 4, and the 
reference-point data are calculated. As a result, a 
conversion is made to coordinates, on the linear CCD, in 
which a point on a line LI at the center of Fig. 14 
serves as the origin. 

This is followed by step S209, at which it is 
determined whether CCDXa is greater than zero. This 
embodiment is such that in a case where the value of 
CCDXa is greater than zero with Xa serving as the 
reference, namely a case where the value is to the left 
of LI, the value of CCDXa is adopted as a concatenated 
CCD coordinate CCDX. On the other hand, if the value of 
CCDXa is equal to or less than zero, the value of CCDXb 
is adopted as the concatenated CCD coordinate CCDX. 
Thus the coordinate values of the linear CCDs 26 of the 
respective linear sensors 20Xa, 20Xb can be concatenated 
with LI searving as the boundary. 

It should be noted that the decisions for this 
concatenation are made using the value of CCDXa. 
However, this does not impose a limitation; the value of 
CCDXb or the values of both CCDXa and CCDXb may be used. 

More specifically, if CCDXa is greater than zero 
("YES" at step S209), control proceeds to step S210, 
where the operation CCDX = CCDXa is performed. Control 
then proceeds to step S212. On the other hand, if CCDXa 
is equal to or less than zero ("NO" at step S209), 


- 37 - 


control proceeds to step S211, Here the operation CCDX 
= CCDXb is performed and then proceeds to step S212. 

Next, at step S212, a conversion is made from CCDX 
obtained by the foregoing processing to the coordinate 
5 value X on the screen 10. The conversion to the 
coordinate value X is performed using the following 
equation employing a magnification a and an offset P 
measured in advance and stored in a non-volatile memory 
or the like: 

^ 10 X = CCDX • a + p 

To obtain the magnification a and offset p, it will 
:2 suffice to perform an input operation at a plurality of 

known points in advance and make a conversion from the 

Ij 

^ CCDX coordinate and the coordinate value on the screen 

^ 15 10 at such time, in a manner similar to that of the 

D reference-point data. 

Though the above-described processing has been 
described with regard to the X coordinate, processing 
with regard to the Y coordinate is executed in similar 
20 manner. 

In a case where coordinate calculation is performed 
using a plurality of the CCDs 2 6 of the kind in which 
the linear sensors 20Xa, 20Xb each have a linear CCD, as 
described above, the linear CCDs are provided with 
25 portions that overlap each other and reference 
coordinates (reference-point data) in which the 
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overlapping portion serves as the reference are set, 
thereby making it possible to treat the linear CCDs as 
if they were a single linear CCD. Further, mounting 
discrepancies can be cancelled out. As a result, 
5 coordinate input over a larger area is made possible 
without inviting a decline in resolution or the like. 

The data signal representing the coordinates {X,Y) 
calculated by the above-described processing is sent 
from the coordinate calculation unit 32 to the 
10 communication controller 33. This data signal and the 
control signal from the control signal detector 72 are 
input to the communication controller 33. The data 
signal and the control signal are both converted to 
p_ communication signals of a predetermined format and then 

in 15 sent to an external display control unit. As a result, 

C3 it is possible to perfom various operations such as 

input of a cursor, menu, characters and line drawings on 
the screen 10 . 

Further, in a case where the sensor is constructed 
20 as an area sensor, four times the number of pixels and 
arithmetic data are required in order to double the 
resolution. By contrast, in a case where the sensor is 
constructed as a linear sensor, it will suffice to 
merely double the number of pixels for each of the X and 
25 y coordinates. Accordingly, a higher resolution can 

readily be obtained by increasing the number of pixels. 
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In accordance with this exabodiment as described 
above, the beam spot is turned on and off at a 
predetermined period by the designating tool, the 
signals prevailing when the beam spot is on and off are 
5 integrated separately and a difference signal between 
these signals is calculated. As a result, the position 
of a pixel at the peak level can be calculated 
precisely. Further, by placing a plurality of linear 
CCDs in such a manner that their detection areas overlap 

10 and setting a coordinate reference point in these 
overlapped detection areas, highly precise, high- 
resolution coordinates can be obtained. Further, it is 
possible to realize a small, light, low-cost apparatus 
in which the effects are extraneous light are 

15 suppressed. 

In the embodiment described above, two linear 
sensors are constructed for each of X and Y coordinates 
and it is so arranged that the coordinates are 
calculated. However, this does not impose a limitation, 

20 In a case where the number of linear sensors is 

increased in order to accommodate a very large area, the 
present invention can be applied by providing the 
mutually adjacent linear sensors with overlapping 
portions and setting a reference point at the portions 

25 of overlap- Thus the invention is not limited to the 
number of linear sensors mentioned in the embodiment. 
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Industrial products contain so-called variation 
errors in terms of mounting position and manufacturing 
tolerance of parts, etc. When the outputs of a 
plurality of linear CCDs are concatenated in the manner 
5 described above, there are instances where error arises 
owing to a variation from one sensor to the next. 

By way of example, there is no problem if the 
linear sensors 20Xa, 20Xb in the foregoing embodiment 
are on the same axis. However, if one linear sensor 

10 20Xb is inclined with respect to the other linear sensor 
20Xa by an angle 0, as shown in Fig. 16, an error will 
be produced at the point of connection between them. In 
this case, as shown in Fig, 17, a step is produced at 
the point of connection and the coordinate advances or 

15 retreats, i.e., a discontinuity occurs in which the X 
coordinate moves back and forth in a case where a 
straight line is drawn from left to right. 

In order to mitigate this error, each coordinate is 
measured with respect to an input of end points of a 

20 CCDXa coordinate changeover point in Fig. 17. 

Let Xau, Xbu represent the X coordinates of the 
upper ends, Xad, Xbd the X coordinates of the lower 
ends, and Ydist the distance from an upper-end reference 
point to a lower-end reference point. A sensor 

25 coordinate quantity AX to be corrected is calculated as 
follows using the y coordinate: 
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AX = y-ydist/{Xau-Xbu)-{Xad-Xbd) 

Further, let Xar, Xbr represent the Y coordinates 
of the upper ends, Xal, Xbl the X coordinates of the 
lower ends, and XYdist the distance from an upper-end 
5 reference point to a lower-end reference point. A 
sensor coordinate quantity AY to be corrected is 
calculated as follows using the x coordinate: 
AY = x-Xdist/{Yar-Ybr)-(Yal-Xbl) 

If AX, AY are used to correct the CCDXb coordinate, 
10 for example, and a changeover is made, a discontinuity 
in the coordinates will not occur. 

In this case, inclination of the overall screen is 
not addressed. The above-described method is strictly 
for correcting the output of one sensor using the output 
15 of the other sensor, such as the output of the linear 
□ sensor 20Xa, as a reference. Transfoirmation of the 

coordinate system or the like is required as a separate 
correction. 

In this regard, the problem can be solved if a two- 
20 dimensional coordinate transformation is carried out 
after the above-described correction. 

A variance in scale caused by a variance in lens- 
to-CCD distance is another cause of variance error. 
In a case where the coordinates of points 
25 equidistant from a certain point are compared with the 
coordinates of both CCDXa and CCDXb, there are instances 
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where the sizes of the coordinates differ. At such 
times it will suffice to correct the sensor output of 
the linear sensor 20Xb so as to achieve conformity with 
the size of the linear sensor 20Xa. For example, if we 

5 let MXa and MXb represent the sensor outputs of the 
linear sensors 20Xa and 20Xb, respectively, at the 
equidistant points, it is possible to effect a 
correction by multiplying the CCDXb coordinate by a 
numerical value, namely a correction coefficient k = 

10 MXa/MXb. By making this correction, a plurality of CCDs 
can be used to improve resolution and assure precision. 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., a host 
computer, interface, reader, printer, etc.) or to an 

15 apparatus comprising a single device (e.g., a copier or 
facsimile machine, etc.). 

Furthermore, it goes without saying that the object 
of the invention is attained also by supplying a storage 
medium storing the program codes of the software for 

20 performing the functions of the foregoing embodiment to 
a system or an apparatus, reading the program codes with 
a computer (e.g., a CPU or MPU) of the system or 
apparatus from the storage medium, and then executing 
the program codes. 

25 In this case, the program codes read from the 

storage medium implement the novel functions of the 
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embodiment and the storage medium storing the program 
codes constitutes the invention. 

Examples of storage media that can be used for 
supplying the program code are a floppy disk, hard disk, 
5 optical disk, magneto- optical disk, CD-ROM, CD-R, 
magnetic tape, non-volatile type memory card or ROM, 
etc . 

Furthermore, besides the case where the aforesaid 
'^j functions according to the embodiment are implemented by 

10 executing the program codes read by a computer, it goes 
W without saying that the present invention covers a case 

'==1 where an operating system or the like running on the 

s computer performs a part of or the entire process in 

v3 accordance with the designation of program codes and 

If! 15 implements the functions according to the embodiment. 

It goes without saying that the present invention 
further covers a case where, after the program codes 
read from the storage medium are written in a function 
expansion board inserted into the computer or in a 
20 memory provided in a function expansion unit connected 
to the computer, a CPU or the like contained in the 
function expansion board or function expansion unit 
performs a part of or the entire process in accordance 
with the designation of program codes and implements the 
25 function of the above embodiment. 

In a case where the present invention is applied to 
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the above-mentioned storage mediuin, program code 
corresponding to the flowcharts shown in Figs. 11, 13 
and 15 described earlier would be stored on this storage 
medixom . 

5 As many apparently widely different embodiment of 

the present invention can be made without departing from 
the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
embodiments thereof except as defined in the appended 
10 claims. 
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